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FOREWORD 



This is n surmary of the 1968-69 evaluation report of the Cooperative 
Urban Teacher Education (CUTE) program. This program, under the direction 
of Dr. Grant Clothier, is currently operating in three locations: Kansas 

City, Missouri; Oklahoma City, Oklahoma; and Wichita, Kansas. 

CUTE is a pre-service teacher education program aimed at improving 
the quality of inner-city teachers and establishing a design for coordinat 
among social and educational institutions to enhance a crucial segnont of 
teacher education. 

Ibis report represents the efforts of a lnrg,c number of people who 
devoted their time and effort to effecting the data collection, analysis, 
and writing of the report. 

Special thanks are duo lliss Grctchen Mcnn and Mrs. Beverly Jacobson 
for helping with the summary. Also special mention should bo made to the 
typists Mrs. Betty Gatlin and Mrs. Estrid Hess. To the students who 
volunteered their tine and to the public schools who helped it: making Mv 
study possible, many thanks. 



James II. Lrwson 

Research t> Evaluation Specialist 
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SUMMARY OF CUTE EVALUATION 
1968-69 



This is the second In a series of evaluation reports of the Cooperative 
Urban Teacher Education (CUTE) program. The results of the 1968-69 eval- 
uation effort are reported in this summary. Some references are made to the 
1967-68 evaluation findings. This occurs when data have not been reported 
in the first summary or when comparisons are made between data from the two 
years. Descriptive statistics of test results for all semesters of the 
CUTE program are tabled in the appendix. 

Purpose 

One purpose of the evaluation this year was to replicate portions 
of the evaluation made during the 1967-68 school year. A second pupose 
was to assess the effects of the program and to provide recommendations to 
the program directors based on evidence and information garnered as a result 
of the evaluation. 

M ethod 

Data were collected at three locations: Kansas City, Missouri, both 

fall and spring semester (CUTE 3 and 4); Oklahoma City, spring semester 
(Oklahoma CUTE 1); and Wichita, spring semester (Wichita CUTE 1). Ihe 
instruments and data gathering devices used this second year had been adapted 
during the first school year of program development (1967-68). Some of the 
original instruments, as will be noted later, were not used the second year. 

Data were collected three times during the 16-week program: the first 

week (T^) , the eighth week (T^), and the sixteenth week (T^). Data for the 
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Comparison groups were collected primarily at T^, since comparable 16-ueck 
programs were not easily located. 

Statistical tests of significance were made for differences occurring 
from one testing time to the next (computer program BMD03V*) . The tech- 
nique used was analysis of covariance for repeated measures. In addition, 
o one-way analysis was used to determine the statistical significance of 
differences in mean scores between student teachers in the CUTE program 
and other student teachers, practice-teaching in the inner city, who volun- 
teered to participate in the evaluation (computer DKD04V*) . For both 
statistical tests, the .05 level of confidence wa3 chosen as indicating a 
statistically significant difference and the Pokeach D-Scalc was used as 
the covariatc. 

One data collecting device, the classroom interaction analysis, did 
not lend itself to statistical hypothesis testing. In this case, percentages 
of categories departing from general practices were inferred to bn 
significant . 

Another key source of information about the program and it6 various 
aspects was the student logs. These loga were kept by the students through- 
out the entire program and were collected after the final interview and 
when grades had been submitted to students' colleges or universities. 
Obviously, an analysis of this type is highly subjective; but the logs 
represent participants' reactions to the program. 

Additional evidence of program effects are being collected in a 
continuing follcw-up of the CUTE graduates. Information about graduates' 
place of employment (inner-city teaching or other), and information from a 

♦Credit must be given to the Computation Center, University of Kansas 
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questionnaire which principals of the graduates are asked to complete, 
are analyzed and provide feedback about the effects of specific aspects 
of the program and the effectiveness of its product — the CUTE graduate. 

Other data being utix^zcd in the follow-up study include a United 
number of attitude scales graduates arc asked to complete. A few graduates 
allow classroom observations to be made and this material is incorporated 
in the follow-up study. It is possible that these date may servo eo a 
means of establishing a relationship between scores on tests, classroom 
observation, and principal's rating. If sufficient data are collected 
(dependent upon the willingness of graduates and principals to participate), 
some index of "success 1 may be established. Alno, if the data arc adequate, 
statistical tests between post-training test scores And test scores after 
intervals of teaching experience (one-year intervals) nay be made.* 

Data Instruments Used 

Biographical data were obtained from students enrolled in the CUTE 
program and the Comparison group. The two groups were compared regarding 
college affiliation (type of college— coeducational or non* coeducational) , 
major course of study, and the he** of the household's occupation. 

Below is a list and br.'- description of the measuring devices used; 
more detailed information will be provided in the next section. 

1. The ItcFEL Interaction Analysis Is a modification of Flanders' ten 

category teacher-pupil Interaction system. It is designed to measure 
teacher talk and pupil talk. The philosophy of the instrument is that 

♦See CUTE Follow-up Fcport 1967-68. 
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direct teacher statements minimize and indirect teacher statements 
maxit ! ze pupils' freedom to respond. 

The Pokcach D-Scale Form F is a 40-item Likert scale, measuring indi- 
vidual differences in openness or closednoss of belief systems 
The Teaching Situation Reaction Test poses a general teaching situation 
to which respondents must react. The test situation includes course 
planning, handling restlessness and inattention, dealing with conflict 
between students, etc. The test authors maintain that the instrument 
'fill predict student teaching grades, os well as teacher performance. 

The Semantic Differential is a data gathering device used to ascertain 
m individual's moaning of certain concept', by use of scales of bi-polar 
adjectives which describe the concept. 

The Minnesota Teacher Attitude Inventory is a well-known and widely 
used instrument designed to: measure directly those attitudes of a 

teacher which predict hew well he will got along with pupils in inter- 
personal relationships, and measure indirectly hen? well satisfied he 
will be with a toachinp career. The instrument is a Likert scale with 
150 five-option items. 

The Cultural Attitude Inventory is a 50-itcn Likert- type attitude 
scale which measures attitudes and knowledge about the culturally- 
deprived child, The Author maintains that the scale can be useful in 
identifying studo.it teachers who could be effective with culturally- 
deprived children. 

The 2-scale is a 66-itcm forced choice attitudinal measure of author* 
itarinnisn which is built against the F-scalo as criterion. The 7-scalc 
Is constructed around four aspects of authoritarianism: dependence, 

rigidity, anxiety, and hostility. 
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Biographical Dat a 

A description of the sample . The Biographical Data Sheet v/as admin- 
istered to CUTE students and Comparison group students. It asked informa- 
tion about: college affiliation (type of college — coeducational or non- 

coeducational), major course of study, and the occupation of the head of 
the household. 

The occupational categories listed on the Biographical Data Snoot 
'•■ore taken from Killer's Ha ndbo ok of Research Design and Soc i al lleasurcmcnt 
“3 adopted from categories originated by the United States Census Bureau. 

The data collected from these data sheets helped to identify the degree 
of similarities and/or differences between the CUTE group and the Comparison 
groups . 

A general description of CUTE and Comparison students has been inferred 
from the data extracted from the individual data sheets. Table 1 contains 
the number of CUTE ond Comparison groups and the total number of students 
in each group for each senes ter. 

Although the idea of comparison groups was conceived earlier, data 
for comparison purposes were first collected durinp the second semester of 
the CUrE program. Those students who composed the first Comparison p,roup 
wor"' student teaching at approximately the same tire as CITE students; 

’’'-wovor, not necessarily in the same schools. 

Comparison students were enrolled in throe area universities: the 

U'ivarsity of Kissouri, Kansas City; Lincoln University, Jefferson City, 
Missouri; and the University of Kansas, Laurence. The two former uni vorsitie ' 
were participating in the CUTE program. 
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Comparison students practice taught in urban, suburban, and inner- 
city schools in approximately six different achool districts. The Comparison 
group was not carefully matched with the CUTE students. 



TABLE 1 

Number of Students in CUTE and Comparison Groups 



Croup Name _____ To t al Number 

Cute 1 (fall, 1967) 22 

Comparison* 

CUTE 2 (spring, 1968) 18 

Comparison 42 

CUTE 3 (fall, 1968) 22 

Comparison 22 

CUTE 4 (spring, 1969) 29 

Comparison 25 

Oklahoma City 1 (spring, 1969) 30 

Comparison** 

Uichita 1 (spring, 1969) 27 

Comparison 26 



* Comparison data were first collected during the CUTE 2 program 
(spring, 1968). 

**Compari8on data were not collected for CUTE 1, Oklahoma City. 
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Subsequent Comparison student volunteers were sought on the basis 
that they were teaching in inner-city schools and at the same time us CUTE 
students. Mo Comparison group students were found to have participated in 
a 16-week, inner-city, student-teaching experience that could be equated 
to the CUTE eight-week student- teaching schedule. 

Conclusions . The following list contains some of the similarities 
noted among CUTE groups: 

1. Most CUTE students attended a college with religious affiliation. 

2. They attended a college with an enrollment between 500 and 2,000 
students. 

3. Most were women. 

4. Most majored in elementary education. 

5. Most of the CUTE students came from hometowns with populations 
of 250,000 or more. 

6. The head of the household from which CUTE students came had 
relatively stable employment. 

7. Most of the CUTE students preferred placement in lower socioeconomic 
schools . 

8. Most CUTE participants were between 20 and 23 years of age. 

Q. Most CUTE students attended coeducational colleges. 

10. The modal size of the high school class of CUTE students was 
200 or more. 

11. Most CUTE students stated a career aspiration in teaching. 

CUTE groups were different in the following way: 

The major difference in CUTE groups appeared to be the occupational 
choice of the head of the househo 1 *« , i.c., service, sales, professionals, 
and skilled workers . 

Similarities between CUTE and Comparison groups include: 

1. Similarity in the size of the college town. 
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2. Most students were women. 

3. Host students attended coeducational schools. 

A. According to modal data, most students majored in elementary 
education. 

5. Most of the students came from hometowns with a population of 
250,000 or more. 

6. Modal data indicates that high school graduating classes for 
CUTE and Comparison students included 200 or more. 

7. The head of the household for all students had relatively 
stable employment. 

8. The age range for all groups were generally between 20 and 23 
years . 

The following list contains the differences between CUTE and 
Comparison groups : 

1. The modal data indicates a different preference for socio- 
economic level of teaching. (Host CUTE students preferred a 
lower socioeconomic teaching situation; most Comparison students 
preferred middle socioeconomic situations.) 

2. CUTE groups attended religious-affiliated colleges; Comparison 
groups attended state-supported colleges. 

3. Generally, Comparison groups attended ouch larger colleges. 

Limitations . There arc some limitations to the amount and kinds of 
information collected using this data sheet. However, in order to assume 
uniformity of information, the decision was made to continue using thi 3 
form, noting some of the following kinds of inadequacies. 

In the categories describing the high school from which students 
were graduated, the following additional information could have been sought: 

1. Was the school private or public? 

2. More accurate description of larger graduating classes. 

In addition to the college najor which was indicated, the college 
minor could have been ascertained. Aspiration toward graduate study should 
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have been another occupational direction for the studont. 

Data such as marital status, academic achievement, and means of 
financial support might have been helpful in determining similarities and 
differences among the groups. 

Questions about a student's working experience, and family history 
might have been useful data for isolating commonalities and/or differences 
among groups. Reason or reasons students enrolled in the CUTE program 
could have been useful data. 

In spite of these limitations, it appears that the data collected 
does illustrate degrees of similarity and difference among CUTE groups and 
between CUTE and Comparison groups . 

HcREL Interaction Analysis 

The McREL Interaction Analysis iu a modification of Flanders' ten 
category teacher-pupil interaction system. During the 1967-68 school year, 
several additional categories were added to the Flanders' categories. 

The verbal balance in this modified system is divided into two major 
categories: student talk and teacher talk. In addition, teacher talk can 

be classified as direct or indirect. A teacher's direct statements minimize 
the freedom of the student to respond; whereas, a teacher's indirect state- 
ments maximize the freedom of the pupils to respond. 

Analysis of the first year's data indicated that some categories were 
not discriminating adequately among pupil-teacher classroom behaviors, as 
a result these categories wore not included in subsequent data collections. 
Other categories were changed to improve future data collections. 




9 



1 



Two categories were added during the 1968-69 school year; current 
categories are: 

1. Teacher accepts feeling 

2. Teacher praises or encourages pupil 

3. Teacher accepts, clarifies, or uses ideas of pupils 

4. Teacher asks a question 

41. Teacher asks a scries of probing questions 

5. Teacher gives information or lectures 

6. Teacher gives directions to pupils 

7. Teacher criticizes or justifies authority 

8. Pupil responds to teacher initiated questions 

81. Pupil reads aloud teacher assignment 

9. Student initiates talk 

10. Constructive activity vithout distinct observable interaction 

11. Disruptive silence or confusion which docs not direct activity 
to an acceptable learning objective 

12. Different pupil talking following a first pupil speaker 
Interpretation of data . The use and interpretation of this data 

collection for CUTE project evaluation is based on the general assumption 
that indirect verbal teaching behavior is more desirable than direct verbal 
teaching behavior. 

Percentages of time student-teachers and pupils talk, the I/D Pvatio, 
the revised i/d ratio, and the percentages of time recorded in verbal 
behavior in categories 3 and 7 were calculated. 
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The I/D ratio reflects the relative number of indirect and direct 
teacher statements. An I/D ratio of .33 means that for every two direct 
statements there was only one indirect statement. The revised i/d is 
calculated without categories 4, 41, 5, lecturing and questioning, and 
indicates whether the teacner is direct or indirect in motivation and 
control . 

TABLE 2 

Normative Indexes of Flanders Interac ti on A na l ysis 



Data Categories _____ 

Percentage of Teacher Talk 
Percentage of Student Talk 
Percentage of Category 3 

Percentage of Category 7 

Regular I/D ratio 
Columns 1, 2, 3, 4, 41/1, 2, 
3, 4, 41, 5, 6, 7 

Revised 1/d ratio 

Columns 1, 2, 3/1, 2, 3, 6, 7 



Normativ e Exp e ctation Indexes 

702 

302 

22 of tallies for direct teachers 
92 of tallies for indirect teachers 

52 of tallies for direct teachers 
12 of tallies for indirect teachers 

.50* 

.50* 



* The larger these indexes, the more indirect. 

Data collection procedures . Observers were trained in 30-40 hour 
training sessions and intra-rater ar.d/or inter-rater reliabilities of .85 
were desired for each observer. (Scott's coefficient).^ Observers wore 



*Ned A. Flanders, Interaction Analysis in the Class room: (Ann Arbor: 
University of Michigan, 1964), p. 15. 




sent individually to classrooms of CUTE and Comparison group students, 
and instructed to make one tally approximately every three seconds for a 
minimum of 20 minutes per student teacher, providing a matrix of approxi- 

2 

mately 400 tallies — sufficient for inference about verbal communications. 

Each observation was of one teaching unit or activity. The sums 
of the matrix for each student teacher were entered into a summary matrix 
in order to achieve group data for comparison. 

Analy sis of dat a. (See p. 30 to p. 35 for tables.) The analysis 
of summary matrixes in terms of "norms" for the 1960-69 school year indicated 
the patterns of verbal behavior of CUTE students. The data, for analytical 
purposes, included indexes for the throe data collecting times at each site. 
The analysis also included a comparison to similar data from volunteer 
comparison groups not in the CUTE program, but who were observed at the 
close of their student teaching experience. 

In addition to the analysis of data in terms of "norms," arbitrary 
indexes were chosen as criteria reflecting the achievement of certain program 
objectives . 

The program objectives and the concomitant indexes include: 

Objective: The 9tudent teacher accepts pupil verbalization of 

feelings . 

Index: Classroom observation data — catcpory 2 — recordings of 

over 2 7 , are interpreted as favorable and exceeds 
'‘current practices.' 1 

Objectives: The student teacher is 'indirect' in his teaching. He 
solicits pupil participation in classroom discussion. 



2 

Ned A. Flanders, ‘Interaction Analysis and Inscrvicc Training, 1 Journal 
of Experimental Education , Fall, 1968, p. 127. 



O 
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Index; 



Classroom observation datn--4-8 cell— less than 30% 
is favorable in that it is less than current practice; 

41-9 cell — and recordings in this cell would be 
evidence of pupil participation; 9-9 coll— change of 
1% or more v?ould be evidence of moving toward increase 
in pupil participation. 

Objective: He asks provocative questions > probing for knowledge 

beyond the information give by pupils which require 
demonstration of student understanding rather than 
memory . 

Index; Classroom observation — any recording in category 41— 

would be acceptable evidence of possessing these skills. 

Data for these arbitrary indexes were collected from each site and 
at each of the three data collecting tines. The data indicated trends or 
patterns in verbal behavior over the 16-week period. Contrasts between 
CUTE and Comparison groups were made for the three locations, but they were 
collected at for the volunteer comparison group. 



Summ ary . The summarized data seemed to indicate that CUTE students; 

1. Utilized praise and encouragement in their teaching. 

2. Demonstrated some skill in the use of probing questions. 

3. Exercised control on interaction in the 4-8 cell. 

4. Demonstrated favorable ability to encourage pupils to initiate 
their own ideas . 



T he Pokeach P-Sc nlc 

The Rokcach D-Scalc, Form F is a 40 item Likert scale to measure 
individual differences in openness or elosedness of belief systems. It 
is assumed that a person's beliefs arc organized into two independent 
parts: a belief system and disbelief system. Rokcach defines a belief 
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system as the psychological system (not necessarily logical) which repre- 
sents all the beliefs, sets, expectancies, or hypotheses, conscious and 
unconscious, that a person at a given time accepts as true of the world in 
which he lives. The disbelief system is composed of a scries of sub- 
systems. It contains all the disbeliefs, sets, expectancies, conscious 
and unconscidus, that a person at n given time rejects as false to one 
degree or another. 

Finally, a belief-disbelief system has a dimension of time. A person's 
belief-disbelief system includes a perspective about the past, present, 
and future, and the manner in which they are related to each other. The 
perspective may be broad or narrow. 

The openness or elosedness of a belief-disbelief system may be 
determined by the extent to which 'the person can receive, evaluate, and 
act on relevant information received from the outside on its own intrinsic 
merits, unencumbered by irrelevant factors in the situation arising from 
within the person or from the outside. ^ 

An additional assumption is made about openness and elosedness: 

...all belief-disbelief systems serve tvo powerful and 
conflicting sets of motives at the same time, the need 
for a cognitive framework to know and to understand and 
the need to ward off threatening aspects of reality. To 
the extent that the cognitive need to know is predominant 
and the need to ward off threat absent, open systems 
should result. .. .but if need to ward off threat becomes 
stronger, the cognitive need to know should become weaker 
resulting in more closed belief system. 



3 

Milton Rokeach, The Open and Closed Hind (New York: Basic Books, 1960), 

p. 57. ~ 

4 

Ibid. , p. 68. 
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The AO items of the scale are distributed among the three aspects or 
dimensions of the definition: the belief-disbelief dimension, the central- 

peripheral dimension, and the time perspective dimension. 

Each item lias six alternatives ranging from "I agree very much 1 ' to 
“I disagree very much" with weights being from +3 to -3. The scoring 
range for an individual item is from 1-7 since the constant A is added 
to the weight of the selected alternatives. The total score for the tost 
is the summation of the item scores. The higher the score the more closed 
is the person’s belief system. 

Statistical tests of the significance of differences have not been 
made for this scale. Ihe primary use of this scale after the first year 
of testing has been to serve as a covarintc for statistical tests of 
differences of other measures. (Sec p. 36 for table.) 

Teaching Situation Reaction Tost 
The TSRT is a paper-pencil test which poses a general teaching 
situation. Forty-four specific questions concerning possible situations 
facing a teacher are then asked including: course planning, handling rest- 

lessness and inattention, handling conflicts between two students, handling 
conflict between a student and the class, working with shy students, etc. 
For each of the AA items, there are four options. The examinee is a3ked 
to rank the four options for each question, indicating his first, second, 
third, and fourth choice. An example of a specific item and the four 
options illustrates the testing procedure: 

You have the entire summer vacation to plan for your class. 
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1. When you begin planning your work you would: 

a. Ask your helping teacher what information he has about 
your assignment. 

b. Examine tha facilities and materials available to you 
and determine how these might be used with members of 
your class. 

c. Read through various publications describing the 
curriculum and draw lesson plan ideas from them. 

d. Visit the school and community and incorporate what 
you learn into your plan. 

Responses arc scored according to a key foilwing procedures sug- 
gested by Remmers, Gage, and Pummel. The test scores may range from 0 to 
330; 880 indicates complete agreement. 

Studies reported by the test authors ascertaining test measures 
suggest that the test will predict student- teaching grades as well as 
teacher performance. These, the author states include subject-matter 
competence, teacher-pupil relationships, and ability to manage classroom 
situations and human relation skills as measured on the Barrctt-Lcnnard, 
Relationship Inventory.^ The authors do not provide information for 
interpretation of group scores. 

Summary of statistical findings . (See p. 37 for the table.) Results 
of the statistical analysis of data for the Teaching, Situation Reaction 
Test indicate there were no statistically significant difference among 
the 1968-69 CUTE groups mean scores from one testing time to another. 

5 

H. H. Remmers, N. L. Gage, and J. F. Rummcl, A Practical Introduction 
to tfcasurement and Evaluation (Few York: Harper and Row, 1965), p. 261. 

^Joncs K. Duncan and John B. Hough, "Technical Review of the TSRT," 
unpublished paper, (Ohio State University, 1966), p. 9 



Also, there were no statistically significant differences between CUTE 
groups and the Comparison groups at T . 

This does not replicate the findings for the 1967-68 CUTE groups. 

Mean differences for 1967-68 CUTE groups across testing times were signifi- 
cant for both groups at the .05 level. The difference in mean scores 

between CUTE 2, T„ and the Comparison group T was also significant at 
^ 3 

the .05 level. Findings for this test did not replicate 1967-68 data, nor 
were research hypotheses supported. Mean scores of CUTE students did not 
change from one testing time to another, nor were their mean scores 
significantly different from Comparison group mean scores. 

The Minnesota Teacher Attitude Inventory 

The ItTAI is a 150 five-option item Likert scale. The options range 
from "strongly agree" to "strongly disagree"; there are no "right" or 
"wrong" answers. The test is scored so that item responses keyed "correct" 
arc given a value of plus one, and item rcsonses keyed 'incorrect" arc 
given a value of minus one. Scores may range from -150 to +150. However, 
in order to avoid negative scores, 100 has been added to all scores reported 
in this study. 

Summary of statistical findings . (Sec p. 38 for table). The results 
of the statistical analysis of the MTAI data indicated that mean scores 
from one testing time to another were statistically significant at the .05 
level for only one of the groups, CUTE 3. Subsequent t-tests indicated 
the Tj-T difference to be nonsignificant. 
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The difference in mean scores at between CUTE and Comparison 
groups were statistically significant for all but one of the CUTE groups 
(CUTE 4). 

These findings differed slightly from those reported for 1967-68. 

That year the !TA1 v:as administered to only one CUTE and Comparison group; 
however, the results indicated statistically significant differences, .05, 
between and T^, as well as a statistically significant difference, .05, 
between CUTE and Comparison, T . 

Tiic difference noted between CUTE and Comparison groups seems to 
have been repeated this year, but hypotheses related to change in irtoan 
scores from one testing time to another for CUTE students have not been 
supported. 



The Pensacola Z-Scale 

The Z-Scale is a 66-iton forced-choice attitudinal measure of author- 
itarianism and is constructed around four aspects of authoritarianism: 
dependency, rigidity, anxiety, and hostility. 

The results of this test were not used in the statistical analysis 
for the 1958-69 data. Findings reported in the 1967-68 evaluation report 
indicated that the differences in moan between the CUTE and Comparison 
students did not reach statistical significance. Furthermore, there seen 
to be other reasons to question the efficacy of this instrument to differ- 
entiate between volunteers and nonvolunteers. This instrument will not be 
used in future data col 'ection. 
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